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istics: 

a) sufficient knowledge of the subject matter and - i . u 
domain tasks and problems a large base of 

b) knowledge of possible behavior of students t,™m 
strategies, underlvine knowi^H.I scuaents, problem solving 
the tateractET lit* t£ ^S^S misConce P tio "« • Based on 
model of the student " the SyStem has t0 ^uild a 

jv S 0 *, 1 *? 6 about teaching strategies and tactics 

d) knowledge about interaction- processes ht^tt 

program and students processes between a computer- 

e) metacognitive knowledge 

^-^S^JS e '?« Ulgent ' ln "8 r "«' 1 tutors , ys . 

.., r ti y ^iS'^irc^trrittS"^" d * nd , sub - 

early mathenstics. In order to reaoh th?! .! i ° f 
been constructed. Althouah a t™w7 . 8 °i ' a "i-P'cgraiL has 
ing systen .as not feasible \S£ iffrated, intelligent tutor- 
»e tried to . "*L ^"T" °f ** Pr ° J ""' 

problen solving-strategL^no „Uc„X5ons § ' ab ° Ut "^"^ 
This paper presents two studies the fSVe- , 

functioning of'Se S^rS^TL".^^"- <* 



RESEARCH 

DOMAIN 



ent types of open sentences to b. d^LSEd^ ^7 differ ' 
placement of the equalizing™ dis " n f uished • Spending on the 
and the operation-sig^ * identit y of the 





type 








i) 


3 + 


6 




* 


2) 


9 - 


2 




* 


3) 


3 + 


* 




5 


4) 


5 - 


* 




2 


5) 


* + 


6 
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6a) 


* . 


3 
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6b) 




5 




3 





type 








7) 


* - 


2 


+ 


5 


8) 


* - 


8 




3 


9) 


9 - 


* 


+ 


4 


10a) 


5 - 


* 




2 


10b) 


2 - 


* 




5 


11) 


7 - 


3 


+ 


* 


12) 


4 - 


6 




* 



table 1 : examples of all possible types of 



open sentences 



Though the area seems to be quite simple in itself Aim i_, 
»y arise beceuse fro. tbe surface features' 
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difficulties with these pro^fL (Lind^U 2° £"* y6arS ° ld have 
Corte & Verschaffel, 1979, 1980). 1980 ' De ' 

STUDY 1: THE SOLVING OP OPEN SENTENCES 

schools, each sctoVuslng'a ttS^^Lj?^?- 1 ^ 
matics. The majority of th* a « nllltT T * in teaching »athe- 
tences directly Th^se t^ll me ! hods u does ™* teach open sen- 
practising number f^ts NoS of tt^SnT "* m ° Stly USed in 
on open sentences. methods P ut a lar 8 e emphasis 

^be" 5 ^ 0 ^^?:: 0 ^^" <"-n to eight years old) used 
nine year? old^'n^rs^ ll^t^^T" C ° 
diversion was that we were not InSrSSFin ™ f f" thiS 
of numberfacts or technical abiUtv W ? mea * Urin 8 Pledge 
solved the problems Tterefor* tl * ! in the Wa ^ ch ildren 
the use of Lcorre^t numberfacts fo/Se se c° ^V" 0 " *» to 
third graders, o„ the oth« h fl S £ * raders - Fbr the 

numbers^ nop!S to Hold j£ ImS USi " g son,ewhat larger 
answers correct ly V^^^S^CS.^ ^ 

ins g^r ^v r r s h do not 

tHa^^ 

Performed well on tJ"!^^*? £ + T- 



grade mean Score relative "score 

(corrected for number of items) 

2 (n: 183) 42.42 (i: 60) 0 77 

3 (n: 156) 81.85 (i : 108) 0.*76 

i - number of items 
n - number of pupils 



^?.?.:_ reSUltS ° f the open sentences "test" 
INDIVIDUAL INTERVIEWS 



some- 



General testing results like the ones above only tell us 
thing about the products of a cognitive D roL« 1 u 
process itself. To get more insight in £? ' n0t ab ° Ut the 
performers and 16 ll p.^^ £ 
performers we selected children that had a high "core « 0 % or 
more correct) on mostly all different nrnhif. f 
performers children who had dif f icStLs^ I^?" " AS lt>W 

CSS*? T e r lected - 2S2^. wl Su' t oa ^ Trl 

required to solve the canonical types 1 and 2 correft^. Se 
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example a: * - 2 - 7 
b: 6 - * + 2 
c: 7 - * - 4 

answer a b c 



strategy 



Add all When the problem structure is not 9 a n 

conform the canonical structure add the 2 e?v- 11 
ens from the problem statement 8 

2. Interpret the operation-sign as a direct in- ? « * 

"ruction to perform the stSed operation on 8 3 
the 2 given numbers 

3 * thfn K S ° 1V ! the Pr ° blem from the ri 8 h t to 9 4 3 

the lilt equalizing sign is placed on 943 

4 * Itf S u 1Ve the P roble » f«» the right to ? 4 3 

unknown *" Pr ° blem firSt States the 

5 * SS?! *! gaP b6tWeen the 0,0 8 iven "umbers. 5 4 3 

When the structure is not canonical, then the 543 

difference between the largest and the smallest 

number in the problem is determined 

6. Expert 



table 3 : strategies 

note: ? - impasse 

Although most problems are 'solvable' with one of ^ „ 

»o,, fl l « / 7 ' 6> readin 8 backwards the problem says 6 

cSncren IS" S^J?' ? Ut iS " probleTfor 

nwur ? f 8 a " ^P"". which has to be overcome in 

order to come up with an answer. One may wonder why children do 
not often just say a problem is impossible. It seems th£ at 
education provides children at an early aee with thl j£ I 
solvability- t-h**-* i~ age witn the notion of 

soxvaDiiicy. there is an answer and that answer has to « 
number (Gelman & GalH«it-el i07«\ n * " nas co De a 
vwciiuau « ^aniseed. , 1978). Repair theory (VanLehn iQjm 

In the interviews impasses were revealed - 

" Wh ; en u^i^ 6 " hesitated a long time before giving an answer 

' t^decJd " * aV V everal di ff«ent answers f„d wfre not ™ble 
to decide on one of them 

" £5! ( .° CCasi ° nall y a child would say that he or she could not 

work the problem or that the problem was impossible in itself 
In two cases the children in this study could find thele^es in 
an impasse: when they thought it neccessary to subtract, lllter 
number from a smaller one or when the problem was actually *an 
impossible one by the way they read it/ln both cases tS imLsse 

Sndren e T Se "SK?" ^ " 0 n ° tion ° f ne * ative numbers ' 
Children have different means to overcome impasses at their 
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numberfacts 

operators 

repairs 



normal form is : 

a +/- b - c 
numberfacts 
operators 
repairs 



4. normal form does not 
begin with unknown 
numberfacts 
operators 
repairs 



5. canonical form 

placement of the 

- sign is not 

essential 
part-whole relation 
numberfacts 
operators 



Find the operation and the two 
numbers , perform the operation. 
If a greater number must be 
subtracted from a smaller: impas- 
se. If impasse, select repair. 

If the form is normal, follow 
model 6a or 6b. If the form is not 
normal (c - a +/- b) , solve the 
problem from right to left. If a 
greater number must be subtracted 
from a smaller: impasse. If impas- 
se, select repair. 

If the form is normal , follow 
model 6a or 6b. If the form is not 
normal, solve the problem from 
right to left. If a greater number 
must be subtracted from a smaller: 
impasse. If impasse, select re- 
pair. 

If the form is canonical, find the 
operation and the two numbers, 
perform the operation. If the form 
is not normal, determine the 
greatest and the smallest number, 
determine the difference. 



6a. (leads to correct answers on all types) 



canonical form 
placement of the 

- sign is not 

essential 
part-whole relation 
numberfacts 
operators 



6b. (expert strategy) 
equality 

part-whole relation 

numberfacts 

operators 



If the form is canonical, find the 
operation and the two numbers, 
perform the operation. If the form 
is not normal, determine which of 
the elements is the whole and 
which are the parts. If the value 
of the whole is unknown, add the 
the parts. If one of the parts is 
unknown, subtract the other part 
from the whole. 



Determine which of the elements is 
the whole and which are the parts. 
If the value of the whole is 
unknown, add the the parts. If one 
of the parts is unknown, subtract 
the other part from the whole. 



table 5 : illustration of the simulation-models 



The description of the models shows that some of the strategies 
predominantly take superficial characteristics of problems into 



for instance know'edge of t£e Tr-t ^f^ 6 "** 1 knowledge, such as 
6b is entirely bas^on^oSieS^f it "Jf ionshi P- Only mo del 
underlying open sentences ^ a t a^x^T tiCal princi P las 
attention to superficial orohl^ L t P doeS not P a y 
interviews, where some ? ^ eioern% W f? den,onst "t*d the 
problem literally. They did keTn 2? f f ? llad C ° re P r °duce a 
ent numbers in tact w £ P the relati °n between the differ- 

reproducing * - 7 - 2 ^ structure, for instance 

«ng / - 3 when the original problem was 3 _ * _ ? nce 

THE DIAGNOSTIC PROGRAM 

d^\^ a 
tt^inc^ 

for diagnosing .'SS^tSS^^S ! h triCtly 

the following rules: race «y- Therefore the program follows 

- lillt "SSSyirS^S 3 T imUin di8 -^~tory power 
understanding or a m«imuf S f baS6d ° n a ^tmm of 
(strategy 1 f nd 6) ° f "^standing of the domain 

' dSerenT ^^2i~^^ d ^ ^ using; 
nosis due to the use of repairs the Same dia 8" 

XS'JV^ T n L?l h l^lr:V nd iS * P-blem, for 

answer is placed on^l » ° tyP<i his or her answ «- The 
problem disappears to mtkf P r °ble*-statement and the 

given opporcu^iS to SoT" 1°* ^ neXt ° ne ' ^ c hild is 
(one of the r^L £ eVY * pr ° blem Cannot be solved 
All in aU the chiid ^ ° f ^ ^ functi °ns as 'cannot-key- 
open se^tence^ ^L^^^^^T S™* ** f °" y 
program registers a the*ansUr"s ? S e 5^ ^ Pr ° gram - 1116 
not offer any feedback n ^ diagnostic program does 
diagnostic process t0 aV ° id int «f«ence with the 

^e^TtTc^^irr^ ° f Ca "° niCal 
correp H„ . . co cne cK if a child can solve these problems 

or th. us. of 1™"^!^^*^"^^ etr ° rS 
many mistalcAQ An , , . a - wnen tne child makes too 

THE REMEDIAL PROGRAM 

The remedial program closely follows the diagnostic categories 
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S£ »£™ ? fi 1 '' Sp6Cific level of knowledge and skill 

incepts 5 Tf £T? " t6a ? ing ab ° Ut the 

eqCanS Thus ^ ' SUCh " the ^-^le relationship and 
ff^; ™" S ' , the P r °g ra " ^ a^ed at enhancing deeper know- 

sppfratf t^! d0main K and n0t 3t teachin « tricks for solving each 
seperate type of problem correctly. 



principle 



example from subprogram for 
strategy 2 



1. Start remedying issues typ- 
ical of the 
used 



strategy being 



% 3 + * - 

> 10 



2. Try to evoke a conflict 
within the pup. 1 by presenting 
counter examples (Socratic 
dialogue) 

3. When no conflict arises, 
present the pupil with a con- 
crete situation, in order to 
demonstrate the impossibility 
of some or other solution 

4. Never give the solution 
directly 



5. Do not instruct pupils in 
algorithms connected to 
cific problems. 



spe- 



% 3 + 10 - * 

> 13 

% 3 + 10 - 7 3+10-13 
which is correct? 



% 



|###| 
0-#-0 



I 7 

0-< 



I 3 | 

0---0 U-#-0 0--- 

How many people got in at 
the bus stop? 



% 3 + * - 

> 



6. Return to the diagnostic 
program as soon as the strate- 
gy specific issues have been 
settled satisfactorily 

% - what appears on the screen 

> - where the child gives an answer 



table 6 



principles of the remedial program, with examples 



SifSiln P J Central iSSUe 1S the P*"-^ole relation. For 

lit tl ?' . 8 V r ! t6gy 2 ' d ° n0t reali2e that open sentences 
are an instance of the part-whole relation. In order to induce a 

ST ^ni C :w iCt th !u CMld iS P rese *** with a counter example 
The canonical form, which will be solved correctly, is meant to 
form a contrast with the incorrectly solved problei. ^ p r 
whole relation is never explicitly stated buAas to be inferred 
The program can also make use of more concrete ways of presenting 
a problem by showing animations. In the example, deslTibld 2 
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ances and boxes with marbTes S^L!? k?" 8 forn,ed b y bal ' 
in relation to the strategy hlZt 1*°*}*™ typ6S ' P^lematic 
»eans type 3,5, and 6 sef tabl^i ^ ' fc (f ° r 2 this 

has shown to be able to soWe * *ilL?l "J^*' the child 

correctly in succession thVchSd is llL !" ° f 6aCh 
sufficient mastery of the cent™ f < Considered to have reached 
is send to the diagnostic Ue at hand< Next the child 

concept does not impl? tnat T"' *7 ^ of a ™ 

ed, so a new diagnostic Lolf f °f «Pertise has been reach- 
child needs more Aching ^ * OUt ^ ^ 

-\d?nf tne^teUng^ «■ ^ortant in 

In the next section the ac£u»l ! ? f mat hematical concepts, 

the classroom will be censored" ntr ° dUCtion ° f the CAI-prograS i„ 

STUDY 2: INTRODUCTION OF THE PROGRAM IN THE CI^SSROOM 

order to evaluate Se effect o"f tht elenentar y -cbool.. In 

test was administered to"he en^re c^" 8 ^ ° Pen sente "«* 
started to work with the „ B „' ! ? "f" before the children 
al weeks later thfsame SfS."S afterwa ^- Sever- 

be able to detect anHasting eff^T"* ±n order to 

other schools functioned as font™? 8eC ° nd grades of two 

attented the regular Lh„n gr ° UpS - ""^ I"*"" only 

solving open sentences h °?£; pro S ram . without extra training il 
in the schools " AM pr ° gram °P«ated for some six weeks 

for this is the onlv ~ on s iJA5iG on a Commodore -64, 

Most of the chilHrnn u ^ mvencivity of the programmer 

before, sfbefo^e s^mne ST" Wlth 8 ^"-computer 

had to be maL fam S l""witr t he r c 0 I i,: J *" the chiJd "" 

children were presented Con P uter - To this purpose the 

illustrated th e P fun^ionW nf E 5""™**°™! program that 
opportunity to pracSse the^eys * ™ d Pr ° Vided 

Each child worked on his or her own with th» oat 
half an hour at most the program wTs inJer^Jn P J° gram ' n Aft6r 
integrated part of the progfaThaS beS f J22 a n" 8t le88t a 
the pupil had been doine irTth! «J fini shed. Data on what 

RESULTS 
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In th« 



thou 
not 



I- T|» «H»er.l.^ r ^jf^^ » * ".tingui.hod 

oili.ion of thTpSpZ d " n ° t take Mrt in th/ 
Tool. 7 RWMnu . aun-ar/of th. r.aulta. 



protoat 
poattoat 1 
poateaat 2 



control, 
group 
n - 76 


2 

non-oxparta 
n - 90 


3 

•xparta of. 
tor roaody 

n - 41 


6 

oxporta 

n - 31 


31.26 


34.31 


36.07 


62.23 


31.67 


37.33 


41.02 


63.61 


61.71 


39.78 


61.29 


62.23 



" " tHat th. protoat .nd th. 

»"bor of Itoojo la 66 par taat 

"VJ 

7: aaan aooroa on eha dlfforont toata 



significant tflff.roneo <i <"o"o3) 
o« protoat botwaon: group 3 an d 4 

on poottoat I (eorroctod for 
oeoroa on protoat) botwoon: group l and 3 

group 2 and 3 

tod Itartt-r^S; S£r Lilt £2.2^ * ** *• »"«•«. 
2 did n.r^"cT^ ** U «=»Udr.n of 

tk.^2^s ^hi^ ss r *LSi fr 6 *- k f n ° t <=>•« 
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^^Xri^A' ChUdr - h - b.e„ worklna 

r««ult in it.tlf Lr Jf lly dl4 * no ««d »• .Xpert. This i. ! Jf? g 
"..thing f^&'^J""- Ch " d ™ "4 » \££ 

Sroup who bMn^o?^ w£h 0th#r h * nd tvo third^f t£ 
•xp.rt-.tag.. P.rti«n7thf. 5 h * P^ogrM, do., not r. ac h th« 
ut.r pro.ram On itz\ 1 "* y 08 due to 'flaws' in th. 

to di.gno.. th. •tr.t.gi.rbfw' ! ln c^ding th. tim. it took 
v.ry much tim.. C * gle " Deln « Di.gnosing did not £k. 



■**n tin. ,td d.v 

(inminut.s) medlan "nge 

group2 - 69 - 8 ; -- 

09.83 8 - 208 

47.78 46 .26 3 0 25 

7 _ 228 

t*U 8 : tim. work.d "wUh "th. "^.disi 



program 

i. .till n,,^ opinion, and oven the Inn..^ 



" "till quit, .cc.pt.bl. 028 6Ven the lon 6«t p.riod 

vh.n childr.n fro. g!^ hS^S?! 0 V Xt 18 Pl«-«»1« th.? 
program for ..». . x t?a t^^^^*™*** w <»* with th. 
in th. .nd. ' cnere would have been more experts 

"Ltiv.ly fast w . y wltn .^t^rogrr PtS * ' 



DISCUSSION 



In th. r.sult ttrcinn *.v 

th. CAI-program ^v. b e .f ^f:?^'^" <* th. evaluation of 

to be ..id .bout th. specific re"L£l T 6 ?- ^ 18 a lot »<»re 
- the procresaion £w results, such as: 

of prffi ^ ° f 6VentUal on th. different types 

B.C.U.. thi. p.p.r ?ocusfs on Jt T ° S f S ln suc o«"ioJ 
J«ch matt.r. M P Jntio^n o ; n SltTi3r nt ! f * ^"P-gram 
The r.m.di.1 program presented I ^esaed somewhere else. 
P.rticul. r t.^hi5"t r inS Li??.^ been based °" one 
■•thod ha. advantages aS SwbacE * S ° Cratlc This 
Stevens and Collin* mq«o\ , 

this method 0l io lnS e ( venL P ^ nt ga °S ^ J""** WOrkln « 
understanding, but ^ tS~« / f ° f fun da»«ntal 

results show, the eventual SL^?/ T 7 1<>ng tlme - A » our 

.xperts did not need very much time on 
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chn dlln"?! !° 5 e ?? m ! 6XpertS • On the other hand, the group of 

lutl ? at 5 ail6d t0 reach th « «P« rt ^age perhaps needed 

much more time than provided. H p neeaea 

The remedial program tries to evoke a cognitive conflict within 
the pupil. However, a child will possibly need to possess a w 
of metacognitive knowledge if he or she is " become aware of 
year's" Sf \i Ct 0 "J? n0t evident that children agS 7 or 8 

I Spi^ne,^??) 8688 8UffiCient "^acognitive knowledge 8 (Brown, 

m^e^om'one^^ ?' that different *™P* of children profit 
!°f* one medial strategy than another. Especially 'weak' 

Slf ^ !h 8UPP ° 8ed C ° Pr ° fit f ™» * remedial strategy 

tort ^ese^h" 1*2 ^ 8tructured ^ming environment ^rf 
Sll'bl ESS/ \ COm P ari8in 8 different remedial strategies 

will be started in the near future *^ 

tibf^.tl£.u!E^ °" th ! a* W- needs to be extended, 
^LJ.h K P resen ted here, indicate that this line of 

" ^omaS^os^ analy8iS ° f Pr ° blen SOlvin « ""Regies in the 
' SS33S^«S^ rf ta ^" ^ —inceptions 
"st^^s 1011 ° f ' Pr ° gram thati8 -ble to diagnose these 

clarifying the central issues relevant in relation to the 
ThJs HIT r? bl6 ? 8< \ lving ** described by the models 

S % a S P ? J / 8 ? l6arly mUch more lifflited th «n the one presented 
in the introduction section for the development of intelligent 

Jnt 6 n a ed . tUt ° ring 8y8temS - For *• P" 8e nt development of 
£££ ^ Pr ? grans that could be introduced at P large within 
S A 8 18 T feasible - °n the one hand research on this 
u P "8 rans 18 8ti11 ^ an experimental stage and on the 
other the development of such programs is enormouf ly time con! 

c'Sfbut^to^r? P ? OP ° 8ed by th6 Pre86nt aUth °" * 8 -ant™ 
contribute to the development of CAI-programs that are based on 

rear:: 8 b andin ! ? f Pr ° bleB SOlvin « P" ce88 « 8 in a ^ are 
ready to be used in the classroom in the near future 

o^^ Pr0gram ^ I?S are able tG dia «n°" the knowledge and miscon- 
ception of children and that are able to remedy on a concept 
level, can contribute to the individualization of education Such 
programs^ would be powerful tools for teachers, for tW can 
hardly be expected to be able themselves to assess each pupil's 
strati l6dge ? f 8 do » 8i n and his or her problem solving 
strategies, let alone taking these into account all the time 
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